Natural User Interface for Robot Task Assignment
نویسندگان
چکیده
We present a user interface that utilizes handtracking and gesture detection to provide a natural and intuitive interface to a semi-autonomous robotic manipulation system. The developed interface leverages humans and robots for what they each do best. The robotic system performs object detection, and grasp and motion planning. The human operator oversees high-level task assignment and manages unexpected failures. We discuss how this low-cost, task-level interface can reduce operator training time, decrease an operator’s cognitive load, and increase their situational awareness. There are many potential applications for this system such as explosive ordnance disposal, logistics package handling, and assembly tasks.
منابع مشابه
Precise but Natural Specification for Robot Tasks
We present Flipper, a natural language interface for describing high level task specifications for robots that are compiled into robot actions. Flipper starts with a formal core language for task planning that allows expressing rich temporal specifications and uses a semantic parser to provide a natural language interface. Flipper provides immediate visual feedback by executing an automatically...
متن کاملRobot control system using SMR signals detection
One of the important issues in designing a brain-computer interface system is to select the type of mental activity to be imagined. In some of these systems, mental activity varies with user intent and action that must be controlled by the brain-computer system, and in a number of other signals, the received signals contain the same activity-related mental activity that should be performed by t...
متن کاملA Gesture Based Interface for Human-Robot Interaction
Service robotics is currently a pivotal research area in robotics, with enormous societal potential. Since service robots directly interact with people, nding \natural" and easy-to-use user interfaces is of fundamental importance. While past work has predominately focussed on issues such as navigation and manipulation, relatively few robotic systems are equipped with exible user interfaces that...
متن کاملNatural User Interfaces for Adjustable Autonomy in Robot Control
The increasing popularity of robotics in modern society makes interacting and communicating with them of critical importance. Although one of the main goals in robotics research is to develop fully autonomous systems, the ability to control robots in teleoperation applications and provide guidance to them for semiautonomous tasks in a natural and intuitive way is still an important research goa...
متن کاملSticky-Finger Manipulation With A Multi-Touch Interface
Manipulation of complex simulated entities like cloth in graphical applications can be non-intuitive and awkward for the user due to the high number of degrees of freedom in their motions. In robotics, direct control of a robotic manipulator for a highlydexterous task is similarly tedious because multiple joints have to be controlled simultaneously, in close coordination and often in varying ve...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2010